Double coherence resonance in neuron models driven by discrete correlated noise 
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We study the influence of correlations among discrete stochastic excitatory or inhibitory inputs on 
the response of the FitzHugh-Nagumo neuron model. For any level of correlation the emitted signal 
exhibits at some finite noise intensity a maximal degree of regularity, i.e., a coherence resonance. 
Furthermore, for either inhibitory or excitatory correlated stimuli a Double Coherence Resonance 
(DCR) is observable. DCR refers to a (absolute) maximum coherence in the output occurring for an 
optimal combination of noise variance and correlation. All these effects can be explained by taking 
advantage of the discrete nature of the correlated inputs. 
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Excitable systems driven by fluctuations exhibit a large 
variety of phenomena where noise plays a constructive 
role. Among the most studied are stochastic resonance, 
the enhanced detectability of weak periodic stimuli for 
an intermediate noise level and coherence resonance 
(CR), the regularization of the system response at an 
optimal noise intensity without any external drive 0, Q . 
CR has been observed in many theoretical and experi- 
mental setups such as electronic devices, semiconductor 
lasers, and climate models (for a recent review cf. 
In neuroscience evidence of CR has been reported for 
the cat's spino-cortical activity Q as well as for a vari- 
ety of single neuronal models. A prominent example is 
the two-dimensional FitzHugh-Nagumo (FHN) model [6] 
that incorporates essential neuronal properties such as 
threshold dynamics (activation) and refractoriness. 

A second type of CR with respect to the level of corre- 
lation has been observed in research areas as diverse as 
laser dynamics , digital circuits [1] , chemical reactions 
and neuronal models [13] ■ In computational neuro- 
science continuous noise is replaced by a series of discrete 
random kicks representing the post-synaptic potentials 
fPSPs) released by excitatory and inhibitory synapses 



111 |12| . Il3l . [IJ, [15| . Correlations are then introduced via 



the method of shared input (cf. such that the 

correlation equals the probability that difl'erent synapses 
deliver PSPs at the same time. Whereas the classical CR 
with respect to the noise intensity can be explained by 
the different dependencies of slow activation and fast ex- 
citation on the noise variance 1^, 17 1 so far the origin 
of the second type of CR has remained unclear. 

In this Letter we address this issue by investigating a 
FHN model driven by a large number of stochastic synap- 
tic inputs with correlations only among trains of either 
excitatory or inhibitory PSPs. In both cases the sys- 
tem exhibits the classical CR at any level of correlation, 
whereas for almost all noise strengths the second type of 
CR can be observed. The discrete nature of the inputs al- 
lows to vary independently correlation strength and noise 
intensity and thus to disclose the different mechanisms 



responsible not only for the CRs but also for the Double 
Coherence Resonance (DCR, i.e., the existence of an op- 
timal combination of noise and correlation strength for 
which the system responds with maximal coherence) dis- 
covered for both excitatory and inhibitory correlation. 
The FHN model can be written as 
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W = V + a- I{t) 
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with a voltage variable V , a recovery variable W and I{t) 
the external synaptic input. We set time scale separation 
(j) = 100 and bifurcation parameter a = ao = 1.05 so that 
the dynamics has only one attractor (a stable focus) but 
is close to the supercritical Hopf bifurcation at a = 1. 

In this study we consider a balanced FHN neuron in 
the high-input regime [ll[ with the input modelled as 
the superposition of an equal number N ^ 100 — 10000 
of Poissonian trains of excitatory and inhibitory PSPs 
(EPSPs and IPSPs, respectively) with the same rate 

N N 

m = Aw^o [ E E '^(^ - ) - E E -^(^ - ^ (2) 
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where tl (t^) are the times of the instantaneous excita- 
tory (inhibitory) kicks of amplitude AVFo- The neuron 
fires upon a single excitatory kick with amplitude higher 
than (AW^)c — 0.0138 (for a = ao). However, here we 
consider kicks of much smaller amplitude AW^o — 0.0014 
with rates vq = 0.3, 0.6, and 1.2 comparable with the 
firing rate Vf = Vf{a) just beyond the bifurcation 21 1. 

We examine the influence of input correlation px on 
the neuronal response restricting ourselves to correlation 
among either excitatory [x — e) or inhibitory [x — i) 
inputs only. Correlations are expressed in terms of the 
Pearson correlation coefficient Px equal to the average 
fraction of shared kicks delivered by each pair of synapses 
or, analogously, to the average fraction of synapses de- 
livering kicks at the same time [l2| . Since in our model 
the inputs of different synapses are not distinguishable 
their effect can be reproduced by two over-all kick trains 



2 



corresponding to correlated and uncorrelated PSPs, re- 
spectively. While the superposition of the uncorrelated 
kick trains can be modelled as a single Poissonian se- 
quence of PSPs of constant amplitude AWq and rates 
i/„ = Nvq ~ 5 — 1200 quite high with respect to the nat- 
ural firing frequency, correlated PSPs are generated using 
a refined method of shared inputs (cf. [HI, [13, [13] ) ■ The 
superposition of the correlated kick trains (with correla- 
tion px) can be represented as a unique over-all Poisso- 
nian train of kicks of variable amplitude AW ^ nx AWq 
and with constant rate = I'o/Px- The kick amplitude 
n (in units of AWq) follows a binomial distribution 
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with average {n) — p^N and variance var[7i] — px{l — 
Px)N. For the balanced case the average input current 
is zero and does not depend on the correlation while 
the current variance per unit time is determined by 
the variability of both correlated and uncorrelated kick 



trains: cr^ = AW^[(ny 



'(n)]/Tx withT^ 



For large N the correlated kicks can be seen as large 
amplitude events that are delivered at a much lower rate 
i^x ^ i^ti than the uncorrelated inputs that can be assim- 
ilated to an almost continuous background. The effect 
of this background consists in renormalizing the bifurca- 
tion parameter according to a = oq ± (AT^) /T^, the shift 
being positive (resp. negative) for a; = e (resp. x = i). 
The influence of the correlated kicks is embodied in the 
variance that for large N (at the leading order) reads as 
CT^ ~ {AW)'^/Tx. Thus in the high input regime the sta- 
tistical properties of the response are determined once the 
average amplitude of the kick (AM^) and are known. 

In the following we characterize the coherence of the 
neuronal response in dependence on noise strength 



and correlation p^ (or equivalently T^) 22| changing the 
latter from full inhibitory correlation pi = 1 to full ex- 
citatory correlation pe = I including the completely un- 
correlated case pe — Pi — 0. As indication of CR we 
employ the occurrence of a minimum in the coefhcient of 
variation R at intermediate noise levels. This quantity 
denotes the standard deviation of the distribution of the 
inter-spike time intervals (ISIs) normalized by its mean 
Tjsi and attains the value for a perfectly regular signal 
and the value 1 for a Poissonian process. 

For fixed Px the coefficient of variation R exhibits a 
minimum for intermediate values of in the whole range 
of excitatory and inhibitory correlations (cf. Fig. [Ij . De- 
pending on the type of correlation we denote this effect 
as excitatory or inhibitory coherence resonance (eCR or 
iCR, respectively) 23]. Furthermore, by ordering the cor- 
relations from full inhibitory to full excitatory for almost 
all noise strengths a minimum of R can be observed 
at intermediate px- Finally, in each half-plane (a'^,px) 
(with X = e and x = i, resp.) an overall minimum for 




FIG. 1: Coefficient of variation _R as a function of noise strength 
for botii excitatory (pe) and iniiibitory (pi) correlation. For 
the sake of brevity we project the axis of the two-dimensional 
plane [pe.pi) on one single axis. In each column a white + marks 
the minimum for fixed variance, while a white X in each row refers 
to the minimum for fixed correlation (i.e., the CRs). Horizontal 
lines mark the cases with no correlation, pe = 1 and pi = 1 
exhibiting CR, eCR and ICR, respectively. Finally, the thin and 
thick white squares indicate the absolute minima obtained for 
excitatory and inhibitory correlation, i.e., the eDCR and iDCR, 
respectively. Data refer to i/o = 0.3. 



R can be identified corresponding to excitatory and in- 
hibitory Double Coherence Resonance (eDCR and iDCR, 
respectively). The iDCR is also the absolute minimum. 

These effects can be better appreciated by considering 
the minimal value R„i for each correlation as a function 
oiTx (cf. Fig. [2]). The curves for three different i/q almost 
coincide indicating that once Tx is fixed the minima 
occur at similar variances ti^. Absolute minima are ob- 
served at finite px and cr^ both for excitatory (eDCR at 
Tf, = Pe/vo — 0.65) and inhibitory correlations (iDCR at 
Ti = pi/fQ ~ 0.9). This behavior of Rm is accompanied 
by a monotonous increase of the corresponding variances 
cr^ when going from p^ = 1 to pi = 1 (cf. Fig.[T]). As we 
show in the following, not only Rm and depend on 
both type and strength of correlation, but also the un- 
derlying mechanisms are completely different from one 
another and in particular from the one responsible for 
CR without correlation [3]. 

Excitatory Coherence Resonance We begin with the 
origin of the eCR at full excitatory correlation pe = 1- 
For this case the ISTdistribution of the output can be 
described, for any cr^, in terms of a Poissonian process 
with average period Tjsi and refractory time Tref- The 
expression of R is simply given by i?p = 1 — Tref/Tjsi, 
however, the course of R reveals a z-like shape with a 
clear minimum (the eCR, cf. inset of Fig. [5]). At low 
variances firing resembles a noise activated process and 
therefore f/s/ ^ Tref and R = Rp ~ 1. For increasing 
cr^ the average kick amplitude (AW) gets larger until one 
single EPSP may be enough to trigger a spike, thus lead- 
ing to more frequent firings and to an abrupt decrease of 
R. This quantity reaches its minimum when a 1 : 1 syn- 
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FIG. 2: Minimal values of the coefficient of variation Rm, ob- 
tained for fixed correlation, versus the period Tp. Data are or- 
dered from full inhibitory correlation to full excitatory correlation. 
Symbols refer to different i^o-values: 0.3 (circles), 0.6 (crosses) 
and 1.2 (squares). The asterisk denotes the uncorrected case 
and the arrows mark the positions of the double coherence reso- 
nances. Inset: R versus for different correlations (i^o = 0.3): 
no correlation (solid line), pe = 1 (dotted line) and pi = 1 
(dashed line). Arrows mark the position of the respective coher- 
ence resonances. 



chronization between the EPSPs and the output spikes 
sets in since now each kick is sufficient to lead the system 
above the firing threshold from any state of the system 
(except during the refractory period). Accordingly, for 
f ^ > the ISI-distribution exhibits a tail with slope Ve 
and R = Rsync = 1 — Tref/Te- Further increasing {AW) 
forces the system to fire even during the refractory pe- 
riod, thus leading to a reduction of Tref which explains 
the final growth of R for > (t,^„. 

Excitatory Double Coherence Resonance This 
mechanism for eCR remains valid also for decreasing cor- 
relation until i?„ reaches its local minimum at pe 
(corresponding to the eDCR, cf. Fig. Beyond the 
eDCR, i.e., for pe < pe, the 1 : 1 synchronization regime 
is no more reached (cf. [5^). For pe < pe the average 
kick amplitude (AVF) is always smaller than the mini- 
mal amplitude (AVF)c needed to elicit a spike (starting 
from the fixed point for the deterministic FHN, i.e., for 
Eq. [T]with I{t) = 0). For pe > pe and sufhciently high 
(or analogously, a) the average kick always overcomes the 
threshold (AW^)^ thus confirming that the regime of 1 : 1 
synchronization is always reached. Since the minimum 
of R is associated with the onset of 1 : 1 synchronization 
(implying Rm = Rsync) Rm dccrcases for 1 > pe > pe- 
For all correlations [pe] 1] this occurs roughly for the same 
amplitude (AW^) ~ AWe (cf. Fig. Oi), thus Tref is not 
significantly altered and the decrease of Rm is due to the 
reduction of Tg with decreasing correlation. Finally, be- 
yond the eDCR, i.e., for pe < pe, the system is no more 
strictly forced by the driving kick train with very high 
frequency, the period of firing decreases (i.e., Tjsi > Te) 
and thus R„i increases. 

Inhibitory Coherence Resonance Turning our atten- 
tion to correlated inhibitory inputs we start with exam- 
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FIG. 3: Excitatory correlation: (a) Minimal amplitude {AW)c 
(solid line) and average kick amplitude (AW^) (dashed lines) 
versus the renormalized bifurcation parameter a. The number in 
proximity of the dashed lines indicate the corresponding values 
of Pe. Data refer to pq — 0.3, in this case pe ~ 0.2. Inhibitory 
correlation: (b) Ratio r{a) for the deterministic FHN model, the 
values of Rm for pi > pi are associated with a-values located 
within the two dashed lines for al the examined !^o.(c) Number 
of inhibitory kicks K received within a certain ISI as a function 
of its duration. Filled circles mark the average for each A'. The 
dashed line indicates a linear fit, the inverse of its slope gives the 
delay per kick S. Data have been obtained from 6000 ISIs for 
uo = 0.3, Pi = 0.6, cr^ = 0.06. 



ining the origin of the iCR at full inhibitory correlation 
Pi = 1. Once more at low variances the emission of spikes 
is due to an activation process with R 1. For increas- 
ing the renormalization of the bifurcation parameter, 
now due to the uncorrelated EPSPs, drives the system 
towards the repetitive firing regime eventually crossing 
the bifurcation at a = 1 and this leads to a fast decrease 
of R. On the other hand, the correlated IPSPs inhibit 
tonic firing, but despite the increase of their amplitude 
with cr^ their action gets less effective. This is because 
the fraction of time r(a) during which the neuron is sen- 
sitive to the arrival of a kick before a spike emission 24 1 
decreases for increasing (i.e., for smaller a). Moreover, 
r{a) exhibits a minimum at a ~ 0.97. Noticeably, Rm is 
associated with corresponding a-values for all pi > pi (cf. 
Fig. [3b). Thus the minimum is due to the uncorrelated 
kick trains that renormalize the bifurcation parameter. 
The final increase of R at large > ct^ is reflected by a 



"quantization" in the ISl-distribution. The single ISI is 
proportional to the number of inhibitory kicks received 
within its duration (cf. Fig. [5};) and for high variances 
the delay per kick S, i.e., the average retardation (with 
respect to the natural firing period) of the next neuronal 
firing induced by a single inhibitory kick, increases and 
consequently the ISI-distribution broadens finally reveal- 
ing a multimodal structure. 

Inhibitory Double Coherence Resonance This 
mechanism for iCR is still valid for decreasing correla- 
tions Pi until Rm reaches its absolute minimum at pi 
(corresponding to the iDCR, cf. Fig. [5]). The decrease 
of Rm with Pi is due to the fact that Rm is associated 
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with an almost constant a- value within the interval [pi ; 1] , 
and that for fixed a the amplitude of the inhibitory kick 
{AW) oc Pi. Consequently the average delay per kick S 
decreases with the correlation until the quantization in 
the ISl-distribution disappears at the iDCR at pi — pi. 
For smaller pi <C pi the frequency of the inhibitory kicks 
becomes more important than their amplitudes. In par- 
ticular, lowering the correlation towards the uncorrelated 
case leads to an increasing rate Vi of inhibitory distur- 
bances that renders the neuronal spiking more irregular, 
which in turn is reflected by the increase of Rm ■ In sum- 
mary, we described novel mechanisms for CR that are 
not, as in the uncorrelated case [3], related to the dif- 
ferent nature of the stochastic processes underlying neu- 
ronal firing at low and high noise but that rely on the 
discrete nature of the correlated inputs. Furthermore, we 
reported the existence of DCRs both for excitatory and 
inhibitory correlations. These DCRs reflect the change 
from the classical CR Q to amplitude-dominated mech- 
anisms responsible for the CR. While the eDCR is related 
to a complete synchronization with the input, the iDCR 
is due to a quantization of the neuronal output. 

Our results indicate that the coherence in the response 
of an excitable system driven by fluctuations can be mod- 
ulated by controlling independently the level of correla- 
tion and the noise variance. This could be of high rele- 
vance for neuronal coding since there are indications that 
correlated activities (as indeed measured, e.g., among 
cortical neurons [l^) can influence the coding ability 
of neuronal populations. More recently neuronal input 
correlation has been linked to changes in attention sug- 
gesting its major impact on the information flow in the 
brain [19| . Remarkably, in simulations with correlated in- 
hibitory input it has been shown that attention (modeled 
as an increase of synchrony in interneuron networks) can 
lead to a decrease of the coefficient of variation of single 
output spike trains ^2^. Furthermore, we have verified 
that the FHN with conductance-based inputs exhibits the 
same coherence effects as reported here for the current- 
driven model. This analysis together with further exten- 
sions to more physiological setups will be the subject of 
future studies. Finally, since most of the reported re- 
sults are not specifically related to the considered model 
we expect that analogous effects can be found also for 
excitable systems in other fields of research. 
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